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(54) Parking assist device and method for assisting parldng 



(57) According to a parking assist device and a 
method for assisting parking of the invention, when a 
parking assist is canceled after a start of the parking as- 
sist, and the parking assist is restarted, a target parking 
position (P2B) is reset at a reset position (PI B). In the 
invention, at this time, the target parking position (P2B) 
Is determined based on a target parking position (P2A) 
which Is set at a parking preparation position (PI A), and 
the detemnined target parking position (P2B) is dis- 
played on a screen of a monitor (4) as a default display 
position of a target parking frame (11) at a reset time. 



FI G . 5 




P2(P2A.P2B) 



Q. 
IIJ 



Printed by Jouve, 75001 PARIS (FR) 



1 EP 1 332 948 A1 2 



Description 

BACKGROUND OF THE INVENTION 

Field of invention 

[0001] The Invention relates to a parking assist device 
and a method for assisting parking. 

Description of Related Art 

[0002] When a driver operates a veh \c\e, it Is relatively 
difficult to park a vehicle such as backing the vehicle into 
the garage and executing parallel parking. Especially, a 
beginning driver is likely to have difficulty in a vehicle 
operation at the time of parking the vehicle. Then, a 
parking assist device for assisting the operation at the 
time of parking the vehicle is known. As the parking as- 
sist device of this type, a parking guide device is dis- 
closed In Japanese Patent Laid-Open Publication No. 
1 1 -208420. The parking guide device guides the vehicle 
to a target parking position by capturing a target parking 
area from a side of the target parking position and su- 
perimposing a target parking frame obtained by compu- 
tation on the captured camera image. 
[0003] However, in the parking guide device disclosed 
in the aforementioned publication, the parking assist 
may be canceled against the driver's will due to shock 
or the like which Is caused when the vehicle runs onto 
a curbstone arranged in front of the garage after the 
parking assist Is started. In such a case where the park- 
ing assist Is canceled against the driver's will, the driver 
usually wants the parking assist to be restarted soon. 
However, in the parking guide device disclosed In the 
Publication, a moving route of the vehicle is determined 
only depending on a relative positional relation between 
a position of the vehicle at which the target parking area 
Is captured from the side, and the target parking area. 
Therefore, once the parking assist is canceled, the ve- 
hicle needs to be moved to the side of the target parking 
position again, which takes a lot of trouble. 

SUMMARY OF THE INVENTION 

[0004] It is an object of the invention to make It pos- 
sible to set a target parking position easily when parking 
assist Is canceled because a vehicle stops or the like 
during the parking assist, and the parking assist is re- 
started. As a result, the parking assist can be restarted 
early. 

[0005] A first aspect of the invention relates to a park- 
ing assist device which includes Image capturing means 
for capturing an area outside the vehble and displaying 
means for displaying a captured image, and displays a 
target parking frame on a screen of the displaying 
means to assist an operation of parking executed by a 
driver. When the parking assist Is canceled after the start 
thereof, and then the parking assist is restarted, the 



parklng.asslst device detemnlnes a target parking posi- 
tion at the restart time of parking assist based on a target 
parking position which Is set prior to the restart time of 
the parking assist, and displays the target parking posi- 

5 tion at the restart time on a screen of the displaying 
means as a default display position (Initial setting posi- 
tion) of the target parking frame at the reset time. 
[0006] Therefore, a position corresponding to the tar- 
get parking position or a position close to this may be 

10 the default display position of the target parking frame. 
Accordingly, when the target parking position Is set, the 
target parking frame is not required to be moved con- 
siderably, which enables an easy setting of the target 
parking position and an early restart of the parking as- 

15 sist. 

[0007] Also, it is preferable to detennine the target 
parking position at the restart time of the parking assist 
by calculating a moving amount of the vehiclef rom when 
the target parking position is set prior to the restart of 

20 the parking assist until when the parking assist is restart- 
ed, and by moving the target position set prior to the 
restart time by the moving amount of the vehicle. 
[0008] The default display position of the target park- 
ing frame at the reset time can be easily determined by 

25 setting the default display position of the target parking 
frame at the reset time in the above-mentioned manner. 
[0009] Also, the target parking frame may be obtained 
based on the determined target parking position at the • 
restart time, arid the obtained target parking frame may 

30 be displayed as a default display on the screen. 

[001 0] In addition, it Is preferable that the parking as- 
sist system is provided with restart judging means for 
judging whether a setting of the target parking position 
Is for a restart of the parking to the target parking posi- 

35 tlon which Is set prior to the restart of the parking assist. 
If the setting of the target parking position is judged as 
for the restart of parking by the restart judging means, 
it is preferable to display the target parking frame ob- 
tained based on the target parking position at the restart 

40 time as the default display on the screen. 

[0011] As mentioned above, the default display posi- 
tion of the target parking frame at the restart time of the 
parking assist can be easily set by providing the restart 
judging means. 

45 [0012] Also, it is preferable to keep displaying the tar- 
get parking frame on the screen of the displaying means 
during execution of the parking assist. 
[0013] The driver can confirm the position at which the 
vehicle Is to be parked with reliability by continuously 

50 displaying the target parking frame during the parking • 
assist. 

[0014] The parking assist device may include target 
parking position setting means for setting the target 
parking position by moving the target parking frame 
55 which is displayed on the screen on the displaying 
means. Accordingly, when the target parking frame is 
displaced from the target parking position at tlie restart 
time of the pari<ing assist, the target parking frame can 
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be easily corresponds to the target parking position by 
the target parking position setting means. 
[0015] A second aspect of the invention relates to a 
method for assisting a parking operation by displaying 
an image captured by image capturing means of a ve- 
hicle and the target parking frame on a screen of dis- 
playing means provided inside the vehicle, in this meth- 
od, when the parking assist is canceled after the start 
thereof, and the parking assist is restarted, the target 
parking position at the restart time is determined based 
on the target parking position which is set prior to the 
restart of the parking assist. Subsequently, the deter- 
mined target parking position is displayed on the screen 
of the displaying means as the default display position 
of the target parking frame at the reset time. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0016] The forgoing and further objects, features and 
advantages of the invention will become apparent from 
the following description of preferred embodiment with 
reference to the accompanying drawings, wherein like 
numerals are used to represent like elements and 
wherein: 

FIG. 1 is a block diagram showing a parking assist 
device according to an embodiment of the inven- 
tion. 

FIG. 2 is a diagram showing an image displayed on 
a monitor. 

FUG. 3 is a plane view showing a state in which the 
vehicle moves to a target parking area. 
FIG. 4 is an explanatory view explaining the target 
parking position which is a relative position with re- 
spect to a parking preparation position. 
FIG. 5 is an explanatory view explaining a relation 
between the target parking position and a reset po- 
sition at which the target parking position is reset. 
FIG. 6 is a flow chart showing an operation of the 
parking assist device according to the embodiment. 

DETAILED DESCRIPTION OF PREFERRED 
EMBODIMENT 

[0017] Hereafter, a preferred embodiment of the in- 
vention will be explained in detail with reference to ac- 
companied drawings. 

[001 8] A parking assist device 1 according to the em- 
bodiment is mounted on a vehicle to execute parking 
assist when the vehicle is parked. As shown in FIG. 1 . 
the parking assist device 1 includes a parking assist 
ECU 2, which Is an electronic control unit. The parking 
assist ECU 2 controls the whole parking assist device 
1 . The parking assist ECU 2 is provided with a CPU, a 
ROM, a RAM, an input signal circuit, an output signal 
circuit, a power circuit, or the like, and stores various 
control routines including a parking assist control rou- 
tine. 



[0019] A camera 3, a monitor 4, and target parking 
position setting means 5 are connected to the parking 
assist ECU 2. The camera 3 can be regarded as image 
capturing means of the invention. The monitor 4 can be 

5 regarded as displaying means of the invention. 

[0020] The camera 3 includes, for example, a wide- 
angle lens which is arranged in a rear portion or a side 
portion of the vehicle, and captures an image of an out- 
side area in back of the vehicle. The image captured by 

^0 the camera 3 is displayed on a screen of the monitor 4. 
The camera 3 may capture the image of the area in back 
of the vehicle at alt the times, or may start capturing the 
image when the vehicle is backed up in order to reduce 
power consumption. Vehicle's backing up can be detect- 

is ed by, for example, a fact that a shift lever Is placed In 
a reverse range. 

[0021] The monitor 4 is an-anged at a position, for ex- 
ample, at a position which is within sight of the driver, in 
an instrument panel. As shown in FIG. 2, a target park- 

20 ing frame 11 which shows a target parking position dis- 
played at a position determined by the parking assist 
ECU 2 in addition to the Image captured by the camera 
3 is displayed on the screen of the monitor 4. 
[0022] As shown in FIG. 2, target parking position set- 

25 ting means 5 is a touch panel type and is displayed on 
a screen of the monitor 4, and includes arrows Y1 to Y4 
in a vertical direction or a lateral direction, and rotationaK 
arrows Y5, Y6 which curve in a clockwise direction or a 
counterclockwise direction. By touching these an^ows' 

30 Y1 to Y6, a target parking frame 11 which is determined 
in advance, and also displayed on the screen of the 
monitor 4 along with the Image captured by the camera 
3 is rotated and moved to set the target parking position. 
Note that when a default position display of the target • 

35 parking frame 1 1 corresponds to a position correspond-"' 
^ ing to the target parking position, the target parking po- 
sition is set without the need for touching the arrows Y1 
to Y6 of the target paricing position setting means. 
[0023] Also, a detemnlning switch SI which the driver 

40 touches when the driver judges that the default position 
display of the target parking frame 11 has corresponds 
to the position corresponding to the target parking posi- 
tion, and an assist canceling switch S2 which the driver 
touches when the driver wants to cancel parking assist 
in midstream are displayed on the screen of the monitor 
4. The parking assist is started by touching the deter- 
mining switch S1 , and the parking assist is canceled by 
touching the assist canceling switch S2. 
[0024] Fu rther, as shown in FIG . 1 , automatic steering 

so means 6 and a starter switch 7 for switching ON/ OFF 
of parking assist mode are connected to the parking as- 
sist ECU 2. The automatic steering means 6 is provided 
with an actuator for steering a steering wheel of the ve- 
hicle, and receives a control signal from the parking as- 

55 sist ECU 2 to steer the steering wheel. Also, the starter 
switch 7 is mounted on, for example, the instrument pan- 
el. In a state where the starter switch 7 is ON, when an 
assist start condition Is established, that is, for example, 
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when the shift lever (not shown) is put into the reverse 
range, a mode is switched to the parking assist mode to 
start certain processing of the parl<ing assist. Alterna- 
tively, in a state where the starter switch 7is OFF, even 
when the shift lever is put into the reverse range and the 
assist start condition is established, the mode is not 
switched to the parking assist mode and the processing 
of the parking assist is not executed. Therefore, for ex- 
ample, when the driver is skilled enough and does not 
need to use such parking assist device 1 , the starter 
switch 7 may remain OFF. 

[0025] Also, a vehicle speed sensor and a steering 
angle sensor 9 are connected to the parking assist ECU 
2. The vehicle speed sensor includes, for example, an 
active wheel speed sensor which is mounted on a wheel 
(not shown) of the vehicle, and detects a rotational 
speed of the wheel to output a speed signal to the park- 
ing assist ECU 2. In the parking assist signal ECU 2, a 
mileage of the vehicle Is calculated based on the speed 
signal output from the vehicle speed sensor. A\so, the 
steering angle sensor 9 is mounted on, for example, a 
steering shaft (not shown) of the vehicle, detects a ro- 
tation angle of a steering, and outputs a detected rota- 
tion angle signal to the paricing assist ECU 2. In the park- 
ing assist ECU 2, a steering angle of the steering wheel 
is calculated based on the detected rotation angle signal 
of the steering. 

[0026] An operation of the parking assist device ac- 
cording to the embodiment will be explained, as follows. 
[0027] In the embodiment, as shown in FIG. 3, an ex- 
ample In which a vehicle M is pari<ed into a parking sec- 
tion D2 of a parking lot PA whose area for parking vehi- 
cles is partitioned into parking sections D1, D2, D3, — 
by a partitioning line will be explained. 
[0028] In a state where the starter switch 7 is ON, 
when a driver of the vehicle M , with the intention of park- 
ing the vehicle into the parking section D2, passes in 
front of the target parking position, turns the vehicle such 
that a rear portion of the vehicle IVI faces the parking 
section D2 to move the vehicle M to a parking .prepara- 
tion position P1 , and puts the shift lever (not shown) in 
a vehicle compartment into the reverse range, the mode 
is switched to the parking assist mode. When the mode 
is switched to the partying assist mode, the camera 3 is 
turned ON first, and an image of an area in back of the 
vehicle is read by the camera 3. The image read by the 
camera 3 is output to the monitor 4 through the parking 
assist ECU 2, and displayed on the screen of the monitor 
4, as shown in FIG. 2. When the image is displayed on 
the screen of the monitor 4, a target parki ng position P2, 
shown in FIG. 3, in a longitudinal, rectangular shape 
which is corresponding to a form obtained when the ve- 
hicle M is seen from the top is set. 
[0029] In order to set the target parking position P2, 
a target parking frame 1 1 is displayed at a default display 
position on the screen of the monitor 4 first. The driver 
touches the arrows Y1 to Y6 in the target pari<ing posi- 
tion setting means 5 as required while looking at the tar- 



get parking frame 11 , to move the target parking frame 
11 , and ultimately set the target parking position P2. In 
the embodiment, when the default position of the target 
parking frame 11 at this time is determined, a computa- 

5 tion for estimating the target parking position P2 (a rel- 
ative position with respect to the parking preparation po- 
sition PI) is executed, and the default position of the 
target parking frame 11 is determined based on the esr 
timated target parking position P2. The target parking 

10 position P2 is estimated based on a running state of the 
vehicle which is obtained before the vehicle M reaches 
the parking preparation position PI. 
[0030] When the parking operation Is executed, a be- 
havior of the vehicle M before reaching the parking prep- 

is aration position P1 is usually as shown in FIG. 3. First 
the vehicle IVI comes close to a position in front of the 
parking section D2 where the driver intends to park the 
vehicle, while moving straight ahead. A moving direction 
of the vehicle M at this time is usually along a width di- 

20 rection of the parking section D2. Secondary, the vehicle 
M passes in front of the parking section D2. At this time, 
from a starting point Q whteh is at a front position of the 
parking section D2, the vehicle M turns and moves, for 
example, in a clockwise direction to the parking prepa- 
ys ration position PI while proceeding in a direction of mov- 
ing away from the parking section D2 by a certain de- 
flection angle (a turning round angle with respect to an 
immediately preceding direction of moving straight) with 
a certain turning radius. Next, the vehicle M turns and 

30 moves while backing up in the clockwise direction with 
the certain tuming radius. Then, the vehicle M finally 
straight backs up to the target parking position P2. . 
[0031] The target parking position P2, which is a rel- 
ative position with respect to the parking preparation po- 

35 sition P1 , is estimated based on a running state (a track 
of the vehicle) by such a regular backing of a vehicle 
Into a garage. More specifically, the target parking po- 
sition P2 is estimated as follows; assuming that the ve- 
hicle M moves straight and turns around so as to exe- 

40 cute such a regular parking as mentioned above when 
the vehicle M moves to the paridng preparation position 
P1 , a deflection angle B (refer to FIG. 4) of the vehicle 
M is determined from the moving distance and the tum- 
ing radius of the vehicle, while the vehicle is turning. The 

"^5 moving distance is detennined based on a signal from 
the vehicle speed sensor, and the turning radius is de- 
termined from an amount of steering of the steering 
wheel which is determined based on a signal from the 
steering angle sensor 9. 

so [0032] In this case, assuming that a minute moving 
distance and the turning radius of the vehicle M while 
the vehicle is tuming are respectively ds and R, the de- 
flection angle 6 is determined by a following formula (1 ). 

55 
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e= Ji//? ds -(i) 

-s.o 

5 



[0033] In the formula (1), an integration interval is -5 
to 0 m. A variation of a direction of the vehicle which is 
caused by the vehicle's moving by 5m until the vehicle io 
reaches the present position is determined by the for- 
mula. The moving distance, i.e., 5m may be changed In 
accordance with a vehicle speed as required. Also, the 
parking assist ECU 2 executes a straight judgement. 
When it is judged that the vehicle M has moved straight 15 
as a resutt of the straight judgement, the deflection angle 
6, which is determined by the formula (1 ), is cleared. In 
the straight judgement, for example, when the vehicle 
has run for 2 m, for example, with a steering maintained 
substantially straight (a steering angle of the steering is ^ 
within ± 30 degrees), it is judged that the vehicle has 
run straight. Therefore, when the vehicle moves straight 
before starting turning, the deflection angle 6 is accu- 
rately detemnined. 

[0034] After the deflection angle 0 is determined, the 25 
target parking position P2 , X1 , Z1) Is determined in 
an X-Y coordinate system whose X-axis and 2-axis are 
respectively a lateral direction and a longitudinal direc- 
tion of the vehbie M with respect to a position of the 
vehicle M, as shown In FIG. 4. In this case, is an angle 30 
of moving toward a direction of turning, which is ob- 
tained when the vehicle M executes the parking opera- 
tion. Also, a coordinate system in which the target park- 
ing position P2 ((j> 1 , X1 , Z1 ) is shown is referred to as 
, a road coordinate system. Formulas for calculating the 35 
target parking position P2 ((]) 1 , X1 , Z1) vary depending 
on degrees of the deflection angles 0. 
[0035] First, when the deflection angle 6 is equal to or 
larger than 0 and less than 30 degrees (0 ^ 0 < 30). an 
amount ^ 1 of moving in the turning direction, an amount 40 
XI of moving in the X direction, and an amount Z1 of 
moving in the Z direction are determined by following 
fonnulas (2) to (4). 

<|>1=90«»-e (2) 



XI = Rmin • (1 .0 - sin 6) + B • cos G (3) 



Z1 = C 4- Rmin • cos 0 + B • sin 8 (4) 

[0036] Note that following are adaptation constants; 
Rmin = 4.05 (m), B = 2.0 (m), C = 1 .0 (m). 55 
[0037] When the vehicle is backed into the garage, 
the track of the vehicle can usually be set on the as- 
sumption that first the vehicle backs up straight, then 



moves back while turning, and backs up straight again. 
The adaptation constant B corresponds to the vehicle's 
last straight backing up, and the adaptation constant C 
corresponds to the vehicle's first straight backing up so 
as to obtain such a track. Also, the adaptation constant 
Rmin is a turning radius which is obtained when the ve- 
hicle backs up while turning, and. for example, a turning 
radius which is obtained when steering is made to the 
fullest extent. These adaptation constants are set based 
on an entire length, a full width, a wheel base, other fea- 
tures, or the like of the vehicle M, as required. 
[0038] When the vehicle moves, a moving amount in 
the X direction at the time of first straight backing up is 
0, a moving amount in the X direction at the time of back- 
ing up while turning around is Rmin -(1.0- sin 9), and a 
moving amount in the X direction at the time of last 
straight backing up is B cos 6. Therefore, as a moving 
amount X1 in the X direction, the formula (3) is derived 
by adding these values. Also, a moving amount in the Z 
direction at the time of first straight backing up is C, a 
moving amount in the Z direction at the time of backing 
up while turning is Rmin • cos 9, and a moving amount 
in the Z direction at the time of last straight backing up 
is B sin 0. Therefore, as a moving amount 21 In the Z 
direction, the formula (4) is derived by adding these val- 
ues together. 

[0039] Note that when the deflection angle 6 is 0 de- 
gree (6 = 0), it is preferable to set in advance whether a 
target parking frame 1 1 is displayed on a right side or a > 
leftside of the vehicle on the screen of the monitor based 
on whether the vehtele M Is parked on a' right rear side - 
or a left rear side, since the vehicle M does not turn 
around. 

[0040] Secondly, when the deflection angle 6 is equal 
to or larger than 30 degrees and less than 50 degrees 
(30 < e < 50), a moving amount <j)1 in the tuming direction 
and a moving amount X1 in the X direction can be de- 
tenmined by the formula (2) and the fonnula (3) as well 
as in the case where the deflection angle is equal to or 
larger than 0 degree and less than 30 degrees. Also, an 
moving amount Z1 in the Z direction can be determined 
by the following formula (5). 

Z1 = 5.5 + 0.05 • (8 - 30) (5) 

[0041 ] When the deflection angle 8 is equal to or larg- 
er than 30 degrees, the moving amount Z1 in the Z di- 
rection increases proportionately with the deflection an- 
gle 0. Accordingly, within a range where the deflection 
angle 0 is equal to or larger than 30 degree and less 
than 50 degrees, the moving amount Z1 in the Z direc- 
tion llneariy increases in accordance with increases in 
the deflection angle 0, as shown by the formula (5). 
[0042] In addition, when the deflection angle 6 is 
equal to or larger than 50 degrees (50 < 0), the moving 
amount (>1 in the turning direction and the moving 
amount X1 in the X direction can be determined by the 
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formula (2) and the formula (3) as in the case where the 
deflection angle 9 is equal to or larger than 0 degree and 
less than 30 degrees. Also, the moving amount Z1 in 
the Z direction can be detemnined by a following formula 
(6). 

Z1 = 6.5 (6) 

[0043] When the vehicle is backed to the garage, the 
deflection angle 6 is usually approximately 20 degrees, 
and even when the deflection angle e is large, It is ap- 
proximately 30 degrees. Also, when the deflection angle 
e increases to equal to or larger than 50 degrees, there 
is almost no variations in the moving amount In the Z 
direction. The target parking position P2 (<> 1, X1 , Zi) 
which is a relative position with respect to the parking 
preparation position PI can be estimated with substan- 
tially high accuracy by fixing the moving amount ZI at 
6.5 m and defining a maximum value. 
[0044] After the target parking position P2 is estimat- 
ed in the above-mentioned manner, the default display 
position of the target parking frame 11 is determined 
based on the estimated target parking position P2. So 
far, a relation between the parking preparation position 
PI and the target parking position P2 has been ex- 
plained in the road coordinate system. However, a con- 
version from the road coordinate system to a monitor 
coordinate system is required in order to display the tar- 
get parking frame 11 on the screen of the monitor 4 
based on the target parking position P2. Therefore, a 
conversion from the target parking position P2 in the 
road coordinate system to the default display position of 
the target parking frame 11 in the monitor coordinate 
system will be explained as follows. 
[0045] First, coordinates of four points (points corre- 
sponding to four corners of the target parking frame 11 ) 
positioned at vertexes of the target parking position are 
determined based on the target parking position P2 ((> 
1 , XI , ZI ) in the road coordinate system which is deter- 
mined in the above-mentioned manner. Secondary, po- 
sitions of first midpoints of the target parking position P2 
are determined based on the coordinates of these ver- 
tex portions. Then, positions of second midpoints be- 
tween each first midpoint and each vertex are deter- 
mined, and positions which quarter a distance between 
each vertex are determined. Namely, three midpoints 
are determined between each vertex, and 12 midpoints 
are determined in total. 

[0046] The coordinates of the four vertexes and the 
12 midpoints determined in the above-mentioned man- 
ner are converted from the road coordinate system into 
the monitor coordinate system by a certain computing 
equation. At this time, only a position of an eye point is 
converted, and distortion of lens is not added. Then, the 
target parking frame 11 is displayed at the default dis- 
play position by adding the distortion of lens to the co- 
ordinate in the monitor coordinate system In accordance 



with the distortion of lens, determining four vertexes and 
12 midpoints, and connecting the four vertexes such 
that each side of the frame passes through these mid- 
points as required. 

5 [0047] When the target parking frame 11 is displayed 
at the default display position on the screen of the hion- 
itor4 In the above-mentioned manner, the driver touch- 
es the arrows Y1 to Y6 in the target parking position set- 
ting nieans 5 as required to modify the position of the 

10 target parking frame 11 and set the target parking posi- 
tion. The target parking frame 11 is displayed in the vi- 
cinity of the target parking position P2 at this time, which 
reduces a setting time when the driver sets the target 
parking position P2. 

15 [0048] When the target parking position P2 is set, the 
• parking assist ECU 2 judges whether a track from the 
parking preparation position PI to the target parking po- 
sition P2 can be drawn based on a relative positional 
relation between the parking preparation position PI , 

20 which is a current position of the vehk;le M, and the set 
target parking position P2. Then, when the parking as- 
sist ECU 2 judges that the track cannot be drawn, it dis- 
plays the target parking frame 11 in red as well as dis- 
playing a comment "guidance is not available" on the 

25 screen of the monitor 4. On the contrary, when the park- 
ing assist ECU 2 judges that the track can be drawn, It 
displays the target parking frame 11, for example, In 
green which is different from red as well as displaying a 
detemnining switch SI on the screen of the monitor 4. 

30 At this time, the target parking frame 1 1 is displayed at 
a position corresponding to the target part<ing position 
P2 on the screen of the monitor 4, and a traveling track 
12 of the vehicle until the vehicle reaches the target 
parking frame 1 1 Is displayed on the screen of the mon- 

35 iter 4. The driver can confimn a route which the vehicle 
M takes from now by visually checking the traveling 
track 12. Also, when there is an obstacle or the like on 
the route, the driver can move the vehicle from the park- 
ing preparation position P 1 by touching an assist can- 

40 celing switch S2 to cancel the parking assist. Alterna- 
tively, when there is no obstacle or the like on the route, 
and the drivers Judges that parking is possible, the park- 
ing assist is started by touching the displayed determin- 
ing switch S1 , without touching the assist canceling 

45 switch S2. 

[0049] When the parking assist is started, the auto- 
matic steering means 6 is activated, which enables the 
driver to execute the parking operation with the parking 
assist by adjusting a vehicle speed as required, without 

so operating the steering. During the execution of the park- 
ing assist, since the target parking frame 11 is continu- 
ously displayed on the screen of the monitor 4, the driver 
can execute the parking operation while confirming that 
the vehicle is moving toward target parking frame lion 

55 the screen of the monitor 4. 

[0050] There is a possibility that the parking assist is 
canceled because the vehicle stops or the like by fulfill- 
ing the assist canceling condition against the driver's 
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will. This may be caused when the vehicle runs onto a 
curbstone or the like, in such a case, the driver usually 
needs to reset the target parking position 92 in order to 
restart the parking assist. In the embodiment, when the 
target parking position P2 is reset, the target parking 5 
frame 1 1 determined based on the previous target park- 
ing position P2 and the running state of the vehicle from 
when the parking assist Is started until when the parking 
assist is canceled is displayed as a default display on 
the screen of the monitor 4. In such a case where the io 
parking assist is canceled against the driver's wilt, the 
vehicle M usually does not deviate from the traveling 
track. In such a case, the target parking frame 1 1 can 
be displayed without deviating from the reset target 
parking position P2 by displaying the target parking is 
frame 11 which is determined in the above-mentioned 
manner as the default display on the screen of the men- 
itor 4. This eliminates the driver having to re-execute a 
setting operation of the target parking position P2, or 
saves the driver the trouble of executing the setting op- 20 
eration. 

[0051] Hereafter, procedures of resetting the target 
parking position will be explained mainly with reference 
to FIG. 5. When the target parking position P2 which is 
set prior to the restart time of the parking assist is dis- 25 
played as the default display position of the target park- 
ing frame 1 1 (FIG. 2) at the restart time of the parking 
assist, a position to whteh the target parking frame 11 is 
moved by a moving amount from the target parking po- 
sition P2A which is set at the start time of the parking 30 
assist to the target parking position P2B which is set at 
the restart time of the parking assist may be the default 
display position of the target parking frame 1 1 at the re- 
set time. In FIG. 5, the parking preparation position that 
Is a position at which the target parking position is set 35 
first is shown as PI A, and the coordinate system with 
respect to the parking preparation position P 1 A is shown 
as a Xa - Za coordinate system. Also, a position at which 
the target parking position is reset Is shown as PI B, and 
the coordinate system with respect to the reset position 40 
PI B is shown as Xb - Zb. Also, the target parking posi- 
tion In the Xa -Za coordinate system is shown as P2A, 
and the target parking position in the Xb - Zb is shown 
as P2B. Note that the target parking positions P2A. P2B 
are shown at an agreed position in FIG. 5. 
[0052] As shown in FIG. 5, referring to a moving angle 
of turning direction of the vehicle M as a moving 
amount of the vehicle M in a direction of an axis Xa as 
AX. and a moving amount of the vehicle M in a direction 
of an axis Zb as AZ respectively, a moving amounts {A(^, so 
AX, AZ) of the vehicle M from the parking preparation 
position P1 A to the reset position P1B are respectively 
detemnined by the following formulas (7) to (9). 



o 

e= p/R ds -(7) 
-P 

0 

AX- jsmff ds • -(8) 



0 

AZ= jcosO'ds " (9) 

-5.0 

[0053] In this case, an integral inten/al -p to 0 is a mov- 
ing distance of the vehicle from the parking preparation 
position PI A to the parking assist cancellation position 
(reset position PI B). 

[0054] The target parking position P2B ((>2, X2, Z2) at 
the reset time is determined based on the moving 
amount (A<]>, AX, AZ) determined by the formulas (7) to 
(9), and the target parking position P2 (<>1 , X1 , Z1 ) de- 
termined at the parking preparation position PI A which 
is detemnined by the formulas (2) to(6), by the following 
formulas (10) to (12). 

<|>2= <|)1 - A4> (10)^' 



X2 = X1-AX (11)^ 



Z2 = Z1 - AZ (12) 

[0055] Note that the target parking position P2B de-*^ 
termined in the above-mentioned manner is a position 
in the Xa - Za coordinate system with respectto the park- 
ing preparation position PI A. Therefore, the target park- ' 
ing position P2B is not a correct value for the vehicle M 
which is at the reset position PI B. Accordingly, it is nec- 
essary to convert the P2B from the Xa - Za coordination 
system with respect to the parking preparation position 
PI A to the Xb - Zb coordination system with respect to 
the reset position P1B, in order to determine a correct 
value. Showing the target parking position P2B after the 
conversion by coordinate points ((}»3. X3. Z3), the target 
parking position P2B ((|>3. X3. Z3) are respectively de- 
termined by the following fomnulas (13) to (1 6). 

«j>3 = <|>2 (13) 



X3 = JX2^+Z2^- sln(a - A4>) (14) 
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Z3 = JX2^ + 22^- cos (a - A^) (15) 

a = cos"'' {22 / 4X2^ + Z2^) (1 6) 

[0056] The target parking frame 11 can be displayed 
at a substantially accurate position by converting the tar- 
get parking position P2B («J)3, X3, Z3), which is deter- 
mined in the above-mentioned manner, from the road 
coordinate system to the monitor coordinate system, 
and using the converted position as the default display 
position of the target parking frame 1 1 . The target park- 
ing frame 11 displayed at the default display position 
corresponds to the target parking position P2, or even 
when the target parking frame 1 1 deviates from the tar- 
get parking position P2, an amount of deviation is 
minute. Accordingly, when setting the target parking po- 
sition P2 at the restart time of the parking assist, the 
driver does not need to move the target parking frame 
11, or even when the driver needs to move the target 
parking frame 11 , the moving amount may be minute. 
This saves the driver the trouble of setting the target 
parking position P2. Thus, the time required to set the 
target parking position may be eliminated or reduced. 
[0057] Also, the parking assist device 1 according to 
the embodiment executes different processing depend- 
ing on whether or not the parking assist is restarted by 
judging whether the parking assist is restarted or not. 
Hereafter, an operation thereof will be explained with 
reference to a flow chart shown in FIG, 6. 
[0058] In the parking assist device, first, whether a 
parking assist control is ON is judged (SI). When it is 
judged that the parking assist control is ON, then wheth- 
er the parking assist control is completed or not is Judged 
(S2). Then, if the parking assist control is completed, the 
parking assist device judges that the parking assist con- 
trol is OFF and does not execute the parking assist (S8). 
If the parking assist control Is not completed, the parking 
assist device judges that the parking assist control is 
ON, and continues the parking assist control (S7). 
[0059] Also, in step SI .when it is judged that the park- 
ing assist control is OFF, then whether the parking assist 
control is being suspended or not is judged (S3). Wheth- 
er the parking assist control is being suspended or not 
can be judged, for example, by detecting a time elapsed 
since the vehicle M stopped after the vehicle M had 
started backing up by putting the shift lever of the vehicle 
l\/t into the reverse range. At this time, if it is judged that 
the parking assist control Is being suspended, whether 
the parking assist control is restarted or not is judged 
(54). A determination on whether the parking assist con- 
trol has been restarted can be effected, for example, as 
follows. That is. a restart switch is displayed on the mon- 
itor while the parking assist operation is being suspend- 
ed and it is determined that the parking assist control 
has been restarted when the switch has been touched. 



[0060] Then, when the parking assist control Is a re- 
started one. the default display position of the target 
parking frame 11 is determined by the fomrjulas (7) to 
(1 6) based on the target parking position P2 which is set 

5 prior to the restart, as mentioned above (S5). Then, the 
driver moves the target parking frame 11 displayed at 
the default display position by touching the arrows Y1 
to Y6 in the target parking position setting means 5 as 
required (86). After this,, the target parking position P2 

10 is established by touching the determining switch 81 . 
However, at this time, the default display position of the 
target parking frame 11 substantially corresponds to a 
position corresponding to the target parking position P2, 
as mentioned above, which usually makes an adjust- 

15 ment operation unnecessary. Then, the parking assist 
control is turned ON by the driver's touching the deter- 
mining switch S1 (S7), and the parking assist control is 
continued. Also, when it is judged that the parking assist 
control is not restarted, the parking assist control is 

20 turned OFF (88), and the parking assist control is not 
executed. 

[0061] Meanwhile, when It is Judged that the parking 
assist control Is not being suspended in step S3, wheth- 
er the parking assist control is started is Judged (S9). 

25 Whether the parking assist control is started or not can 
be judged by, for example, detecting whether the shift 
lever is put into the reverse range or not, as mentioned 
above. When it Is judged that the parking assist control 
is started, the target parking position P2 is estimated, 

3o for example, based on the running state wh ich is detect- 
ed before the vehicle M reaches the parking preparation 
position P1 , as mentioned above, and the default dis- 
play position of the target parking frame 11 is deter- 
mined by the formulas (1 ) to (6) based on the estimated 

35 target parking position P2 (S10). The target parking 
frame 11 is displayed at the determined default display 
posltiori, and then the driver moves the target parking 
frame 11 displayed at the default display position as re- 
quired by touching the an^owsYI to Y6 In the target park- 

40 ing position setting means 5 to modify the target parking 
frame 11 (811), Then, the target parking position P2 is 
established by touching the determining switch SI . After 
this, the parking assist control is turned ON by the driv- 
er's touching the determining switch SI (87), and the 

45 parking assist control Is continued. Alternatively, when 
it is judged that the parking assist control is not started 
in step S9, the parking assist control is turned OFF (SB), 
and the parking assist control is not executed. 
[0062] As mentioned above, at the restart time of the 

50 parking assist, the target parking frame 11 can be dis- 
played as the default display at a position corresponding 
to the target parking position P2 with high accuracy by 
judging wh ether the currently executed parking assist is 
the restarted parking start or not. 

55 [0063] While the prefen-ed embodiment of the inven- 
tion has been explained, the invention is not limited to 
the above-mentioned embodiment. For example. In the 
above-mentioned embodiment, the target parking posi- 
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tion which is set first is exemplified as a target parl<ing 
position which is set prior to the restart of the parl<lng 
assist. However, for example, when the parking assist 
has restarted twice or more, the target parl<ing position 
which is set most recently may be the target parking po- 
sition which is set prior to the restart of the parking as- 
sist. As a matter of course, when the parking assist has 
been restarted twice or more, the target parking position 
which is set first may be the target parking position set 
prior to the restart of the parking assist. 
[0064] Also, In the embodiment, automatic steering 
means is provided. However automatic braking means 
or automatic driving means In addition to the automatic 
steering means may be provided such that the driver 
can execute the parking operation without executing a 
vehicle speed adjustment operation. As a matter of 
course, one or two of the above-mentioned means may 
be provided such that the driver can execute the parking 
assist. 

[0065] As explained above, according to the embod- 
iment, when the parking assist is cancelled during the 
parking assist execution because the vehicle stops or 
the like, and the parking assist is restarted, the target 
parking position can be easily set, which enables an ear- 
ly start of the parking assist after the restart. 



Claims 

1 . A parking assist device whk;h is provided with im- 
age capturing means (5) for capturing an Image of 
an area outside the vehicle, and displaying means 
(4) for displaying the captured image, and displays 
a target parking frame (11) on a screen of the dis- 
playing means (4) to assist a parking operation ex- 
ecuted by a driver of the vehicle characterized in 
that 

when a parking assist is canceled after a start 
of the pari<ing assist, and the parking assist is re- 
started, the parking assist device determines a tar- 
get parking position (P2B) at a restart time of the 
parking assist based on a target parking position 
(P2A) set prior to the restart time of the parking as- 
sist, and displays the determined target parking po- 
sition (P2B) on the screen of the displaying means 
(4) as a default display position of the target parking 
frame (11 ) at a reset time. 

2. The parking assist device according to claim 1, 
ciiaracterized In that 

a moving amount {A^, AX, AZ) of the vehicle 
obtained from when the target parking position 
(P2A) is set prior to the restart time of the parking 
assist until when the parking assist is restarted is 
determined, and the target parking position (P2B) 
at the restart time is determined by moving the tar- 
get position (P2A) set prior to the restart by the mov- 
ing amount of the vehicle. 



3. The parking assist device according to claim 1 or 2, 
characterized in that 

the target parking frame (11) determined 
based on the target parking position (P2B) at the 
s restart time is displayed as a default display on the 
screen. 

4. The parking assist device according to claim 3, 
characterizcrd in that 

10 the parking assist device further comprise re- 

start judging meansforjudging whether a setting of 
the target parking position (P2) is a setting of the 
target parking position (P2B) at the restart time, and 
the target parking frame (11) is displayed as 

IS the default display on the screen when the setting 
of the target parking position is judged as the target 
pari<lng position (P2B) at the restart time by the re- 
start judging means. 

20 5. The parking assist device according to any one of 
claims 1 to 4, characterized In that 

the target parking frame (11) is displayed on 
the screen of the monitor (4) during execution of the 
parking assist. 

2S 

6. The parking assist device according to claim 5, 
characterized by further comprising: 

target parking position setting means (5) which 
30 Includes a portion operated by a driver of the 

vehicle so as to move the target parking frame 
(11 ) displayed on the monitor (4) on the screen, 
and a portion operated by the driver so as to 
set the displayed target parking frame (11) as 
35 the target pari<ing position (P2). 

7. A method for assisting a parking operation by dis- 
playing an image captured by image capturing 
means (5) of a vehicle and a target parking position 

40 (11) on a screen of displaying means (4) provided 
Inside the vehk^le characterized in that 

when a parking assist is canceled after a start 
of the parking assist, and the parking assist is re- 
started, a target parking position (P2B) at the restart 

45 time is detemriined based on a target parking posi- 
tion (P2A) which is set priortothe restart time of the 
periling assist, and the detemriined target parking 
position (P2B) is displayed on the screen of the dis- 
playing means (4) as a default display position of 

so the target paridng frame (1 1 ) at a reset time. 
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